Automatic targeted illumination based on aggregate illumination from multiple light sources

ABSTRACT

Systems and methods for automatic targeted illumination based on aggregate illumination from multiple light sources are disclosed. In embodiments, a method includes: determining, by a computing device, a localized area of a defined physical location based on received location information; determining, by the computing device, a desired level of brightness for the localized area; calculating, by the computing device, an illumination level at the localized area based on current illumination levels of lighting devices within the defined physical location and locations of the lighting devices within the defined physical location; generating, by the computing device, instructions to effect a change in one or more of the lighting devices, wherein the change in the one or more lighting devices results in the desired level of brightness for the localized area; and sending, by the computing device, the instructions to at least one controller of the one or more lighting devices.

BACKGROUND

The present invention relates generally to lighting controls and, moreparticularly, to automatic targeted illumination based on aggregateillumination from multiple light sources.

Smartphones and other mobile user devices are increasingly beingutilized to interface with remote electronic devices. In one example,mobile phones are utilized to control lights, curtains and/or athermostat via communication with an on-site controller. Variousadditional methods have been developed for selectively changing lightingwithin an enclosed space. For example, systems have been described whichassociate selectable buttons with lighting scenes stored as profiles,wherein a user can press one of the buttons to change lighting within ahome based on the stored profiles.

SUMMARY

In an aspect of the invention, a computer-implemented method includes:determining, by a computing device, a localized area of a definedphysical location based on received location information; determining,by the computing device, a desired level of brightness for the localizedarea; calculating, by the computing device, an illumination level at thelocalized area based on current illumination levels of lighting deviceswithin the defined physical location and locations of the lightingdevices within the defined physical location; generating, by thecomputing device, instructions to effect a change in one or more of thelighting devices, wherein the change in the one or more lighting devicesresults in the desired level of brightness for the localized area; andsending, by the computing device, the instructions to at least onecontroller of the one or more lighting devices.

In another aspect of the invention, there is a computer program productincluding a computer readable storage medium having program instructionsembodied therewith. The program instructions are executable by acomputing device to cause the computing device to: determine a localizedarea of a defined physical location based on an image of the definedphysical location; determine a desired level of brightness for thelocalized area based on user input; calculate an illumination level atthe localized area based on current illumination levels of lightingdevices within the defined physical location, and locations of thelighting devices within the defined physical location; generateinstructions to effect a change in one or more of the lighting devices,wherein the change in the one or more lighting devices results in thedesired level of brightness for the localized area; and send theinstructions to at least one controller of the one or more lightingdevices.

In another aspect of the invention, there is a system including: aprocessor, a computer readable memory and a computer readable storagemedium associated with a computing device; a plurality of lightingdevices within a defined physical location; program instructions todetermine a localized area of the defined physical location based ondata received by the computing device; program instructions to determinea desired level of brightness for the localized area; programinstructions to calculate an illumination level at the localized areabased on current illumination levels of the lighting devices andlocations of the lighting devices within the defined physical location;program instructions to generate instructions to effect a change in oneor more of the lighting devices, wherein the change in the one or morelighting devices results in the desired level of brightness for thelocalized area; and program instructions to send the instructions to atleast one controller of the one or more lighting devices. The programinstructions are stored on the computer readable storage medium forexecution by the processor via the computer readable memory.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is described in the detailed description whichfollows, in reference to the noted plurality of drawings by way ofnon-limiting examples of exemplary embodiments of the present invention.

FIG. 1 depicts a computing infrastructure according to an embodiment ofthe present invention.

FIG. 2 shows an exemplary environment in accordance with aspects of theinvention.

FIG. 3 shows a flowchart of steps of a method in accordance with aspectsof the invention.

FIGS. 4A and 4B illustrate an exemplary use scenario in accordance withembodiments of the invention.

DETAILED DESCRIPTION

The present invention relates generally to lighting controls and, moreparticularly, to automatic targeted illumination based on aggregateillumination from multiple light sources. In embodiments, a system isprovided for changing the level of brightness at a localized area withina larger defined physical location, based on current illumination levelsof lighting devices at the physical location, the location of thelighting devices in the physical location, and user data. Inembodiments, to change the level of brightness of any area within alocation, a user focuses his or her mobile device camera towards thearea, and with touchscreen finger gestures or the like, the userindicates a desired change to the brightness of the area. In aspects,based on a level of brightness selected by the user, software willautomatically change the level of brightness of each participating lightsource at the location so that a desired/required level of brightnesscan be achieved in the select area. In embodiments, the user can usetheir mobile device to create various types of event-based brightnesscontrol rules for a location. In aspects, a lighting control system ofthe invention identifies the event based on camera feed analysis,surrounding context analysis, sensor data, etc.

In an enclosed location (e.g., an auditorium, a room, etc.) multiplesources of light (lighting devices) are placed to illuminate thelocation. Each source of light contributes to the illumination in thelocation. Changing individual light sources may not provide the requiredamount of brightness desired for a select portion of the location.Existing methods of remotely controlling individual light sources do notaddress this problem of select illumination.

Advantageously, embodiments of the invention provide improvements to thefunction of mobile devices by enabling the mobile devices to dynamicallyadjust lighting at a location to provide a desired illumination levelfor a select area within the location, based on positioning of on-sitelights and current illumination levels. In aspects, dynamic adjustmentof lighting includes effecting a change in brightness (illuminationlevel) and/or position of lighting devices at a location.Implementations of the invention utilize unconventional steps to enablea lighting system to calculate actual and desired aggregate illuminationlevels (illumination from multiple light sources) at a select areawithin a defined location. Thus, embodiments of the invention provide atechnical solution to the problem of controlling illumination at alocalized area within a larger location, when the illumination isprovided by multiple spaced light sources. Unlike existing methods thatremotely control light sources individually, the present inventionenables a user to select an area, and then automatically change thebrightness level for that area based on the determined cumulativelighting effects of multiple light sources.

The present invention may be a system, a method, and/or a computerprogram product at any possible technical detail level of integration.The computer program product may include a computer readable storagemedium (or media) having computer readable program instructions thereonfor causing a processor to carry out aspects of the present invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, configuration data for integrated circuitry, oreither source code or object code written in any combination of one ormore programming languages, including an object oriented programminglanguage such as Smalltalk, C++, or the like, and procedural programminglanguages, such as the “C” programming language or similar programminglanguages. The computer readable program instructions may executeentirely on the user's computer, partly on the user's computer, as astand-alone software package, partly on the user's computer and partlyon a remote computer or entirely on the remote computer or server. Inthe latter scenario, the remote computer may be connected to the user'scomputer through any type of network, including a local area network(LAN) or a wide area network (WAN), or the connection may be made to anexternal computer (for example, through the Internet using an InternetService Provider). In some embodiments, electronic circuitry including,for example, programmable logic circuitry, field-programmable gatearrays (FPGA), or programmable logic arrays (PLA) may execute thecomputer readable program instructions by utilizing state information ofthe computer readable program instructions to personalize the electroniccircuitry, in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the blocks may occur out of theorder noted in the Figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

Referring now to FIG. 1, a schematic of an example of a computinginfrastructure is shown. Computing infrastructure 10 is only one exampleof a suitable computing infrastructure and is not intended to suggestany limitation as to the scope of use or functionality of embodiments ofthe invention described herein. Regardless, computing infrastructure 10is capable of being implemented and/or performing any of thefunctionality set forth hereinabove.

In computing infrastructure 10 there is a computer system (or server)12, which is operational with numerous other general purpose or specialpurpose computing system environments or configurations. Examples ofwell-known computing systems, environments, and/or configurations thatmay be suitable for use with computer system 12 include, but are notlimited to, personal computer systems, server computer systems, thinclients, thick clients, hand-held or laptop devices, multiprocessorsystems, microprocessor-based systems, set top boxes, programmableconsumer electronics, network PCs, minicomputer systems, mainframecomputer systems, and distributed cloud computing environments thatinclude any of the above systems or devices, and the like.

Computer system 12 may be described in the general context of computersystem executable instructions, such as program modules, being executedby a computer system. Generally, program modules may include routines,programs, objects, components, logic, data structures, and so on thatperform particular tasks or implement particular abstract data types.Computer system 12 may be practiced in distributed cloud computingenvironments where tasks are performed by remote processing devices thatare linked through a communications network. In a distributed cloudcomputing environment, program modules may be located in both local andremote computer system storage media including memory storage devices.

As shown in FIG. 1, computer system 12 in computing infrastructure 10 isshown in the form of a general-purpose computing device. The componentsof computer system 12 may include, but are not limited to, one or moreprocessors or processing units (e.g., CPU) 16, a system memory 28, and abus 18 that couples various system components including system memory 28to processor 16.

Bus 18 represents one or more of any of several types of bus structures,including a memory bus or memory controller, a peripheral bus, anaccelerated graphics port, and a processor or local bus using any of avariety of bus architectures. By way of example, and not limitation,such architectures include Industry Standard Architecture (ISA) bus,Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, VideoElectronics Standards Association (VESA) local bus, and PeripheralComponent Interconnects (PCI) bus.

Computer system 12 typically includes a variety of computer systemreadable media. Such media may be any available media that is accessibleby computer system 12, and it includes both volatile and non-volatilemedia, removable and non-removable media.

System memory 28 can include computer system readable media in the formof volatile memory, such as random access memory (RAM) 30 and/or cachememory 32. Computer system 12 may further include otherremovable/non-removable, volatile/non-volatile computer system storagemedia. By way of example only, storage system 34 can be provided forreading from and writing to a nonremovable, non-volatile magnetic media(not shown and typically called a “hard drive”). Although not shown, amagnetic disk drive for reading from and writing to a removable,non-volatile magnetic disk (e.g., a “floppy disk”), and an optical diskdrive for reading from or writing to a removable, non-volatile opticaldisk such as a CD-ROM, DVD-ROM or other optical media can be provided.In such instances, each can be connected to bus 18 by one or more datamedia interfaces. As will be further depicted and described below,memory 28 may include at least one program product having a set (e.g.,at least one) of program modules that are configured to carry out thefunctions of embodiments of the invention.

Program/utility 40, having a set (at least one) of program modules 42,may be stored in memory 28 by way of example, and not limitation, aswell as an operating system, one or more application programs, otherprogram modules, and program data. Each of the operating system, one ormore application programs, other program modules, and program data orsome combination thereof, may include an implementation of a networkingenvironment. Program modules 42 generally carry out the functions and/ormethodologies of embodiments of the invention as described herein.

Computer system 12 may also communicate with one or more externaldevices 14 such as a keyboard, a pointing device, a display 24, etc.;one or more devices that enable a user to interact with computer system12; and/or any devices (e.g., network card, modem, etc.) that enablecomputer system 12 to communicate with one or more other computingdevices. Such communication can occur via Input/Output (I/O) interfaces22. Still yet, computer system 12 can communicate with one or morenetworks such as a local area network (LAN), a general wide area network(WAN), and/or a public network (e.g., the Internet) via network adapter20. As depicted, network adapter 20 communicates with the othercomponents of computer system 12 via bus 18. It should be understoodthat although not shown, other hardware and/or software components couldbe used in conjunction with computer system 12. Examples, include, butare not limited to: microcode, device drivers, redundant processingunits, external disk drive arrays, RAID systems, tape drives, and dataarchival storage systems, etc.

FIG. 2 shows an exemplary location illumination environment 50 inaccordance with aspects of the invention. The location illuminationenvironment 50 includes a network 55 connecting a user computer device60 with a plurality of lighting devices 62A. Lighting devices 62A can beany desired type of lighting device, including personal lamps,professional lighting devices, light emitting diodes, light bulbs, orother types of devices that are configured to provide light. In aspects,the location illumination environment 50 includes one or more of thefollowing: one or more lighting transportation devices 64 for adjustingthe position of respective repositionable lighting devices 62B, one ormore cameras 66, and one or more sensors 68. In embodiments, the usercomputer device 60 is in communication with a lighting controller 70 viathe network 55.

The network 55 may be any suitable communication network or combinationof networks, such as a local area network (LAN), a general wide areanetwork (WAN), and/or a public network (e.g., the Internet). Inembodiments, the user computer device 60 comprises the computer system12 of FIG. 1, and is connected to the network 55 via the network adapter20 of FIG. 1. In aspects, the user computer device 60 is a mobiledevice, such as a smartphone, tablet, laptop computer, etc.

In implementations, the user computer device 60 includes a plurality ofprogram modules (e.g., program module 42 of FIG. 1) executed by the usercomputer device 60 and configured to perform one or more functionsdescribed herein. In embodiments, the user computer device 60 includesone or more of: a graphical user interface (GUI) module 72 configured toprovide a user interface for illumination controlling aspects of theinvention; a camera module 74 configured to obtain and/or analyze imagedata from a camera (not shown) of the user computer device 60; alighting control module 76 configured to control illumination levelsand/or positioning of lighting devices at a location (e.g., lightingdevices 62A, 62B); and an illumination module 78 configured to calculatechanges in illumination levels and/or positioning of lighting devices62A, 62B based on desired illumination levels for a particular area of apredetermined location, current illumination levels, and locations ofthe lighting devices 62A, 62B. In implementations, the illuminationmodule 78 utilizes stored information regarding the position of lightingdevices 62A, 62B within a location, current illumination levels of thelighting devices 62A, 62B, and/or historic lighting preferences of auser in a lighting database 80. In aspects, the user computer device 60receives lighting rules data from a user and saves rules based thereonin a rule database 82.

In embodiments, certain functions discussed above with respect to theuser computer device 60 are implemented at the remote lightingcontroller 70. In implementations, the lighting controller 70 includescomponents of the computer system 12 of FIG. 1, and is connected to thenetwork 55 via a network adapter (e.g., the network adapter 20 of FIG.1). The lighting controller 70 may be configured as a special purposecomputing device that is part of a lighting system for a location. Forexample, the lighting controller 70 may be a special purpose computingdevice dedicated to illumination control of lighting devices 62A, 62B atan indoor or outdoor venue. In embodiments, the lighting controller 70is a cloud-based server providing illumination control services to oneor more physical locations.

In implementations, the lighting controller 70 includes a plurality ofprogram modules (e.g., program module 42 of FIG. 1) executed by thelighting controller 70 and configured to perform one or more functionsdescribed herein. In aspects, the lighting controller 70 includes acommunication module 83 configured to receive data from one or more usercomputer devices (e.g., user computer device 60). In aspects, thecommunication module 83 provides a user interface to a plurality of usercomputer devices 60, enabling users to provide data regarding lightpreferences to the lighting controller 70. In embodiments, the lightingcontroller 70 includes a lighting control module 86 configured tocontrol illumination levels and/or positioning of lighting devices 62A,62B at a location, and an illumination module 88 configured to calculatechanges in illumination levels and/or positioning of lighting devices62A, 62B based on desired illumination levels for a particular area of apredetermined location, current illumination levels, and locations ofthe lighting devices 62A, 62B. In implementations, the illuminationmodule 88 utilizes stored information regarding the position of lightingdevices 62A, 62B within a location, current illumination levels of thelighting devices 62A, 62B, and/or historic lighting preferences of auser from a lighting database 90. In aspects, the lighting controller 70receives lighting rules data from a user (e.g., from user computerdevice 60) and saves rules based thereon in a rule database 92.

In implementations, the one or more lighting devices 62A includeassociated controllers 63A configured to receive instructions from theuser computer device 60 and/or the lighting controller 70, wherein thecontrollers 63A adjusts illumination levels of an associated lightingdevice 62A based on the received instructions. In aspects, onecontroller 63A is responsible for controlling illumination of multiplelighting devices 62A.

In implementations, the one or more lighting transportation devices 64of the present invention utilize mechanical and/or electrical tools orequipment to adjust the position and/or illumination levels of anassociated lighting device 62B based on instructions received by acontrol module 63B of the lighting transportation device 64. In aspects,one control module 63B is responsible for the adjustment of multiplelighting devices 62B.

In embodiments, the one or more sensors 68 are configured to send data(e.g., real-time data) to one of the user computer device 60 andlighting controller 70 via the network 55 for use in determining atriggering event has occurred and/or determining a location of a userwithin a location. Similarly, in aspects, the one or more cameras 66 maybe configured to send data (e.g., real-time data) to one of the usercomputer device 60 and lighting controller 70 via the network 55 for usein determining a triggering event has occurred and/or determining alocation of a user within a location.

The quantity of devices and/or networks in the location illuminationenvironment 50 is not limited to what is shown in FIG. 2. In practice,the location illumination environment 50 may include additional devicesand/or networks; fewer devices and/or networks; different devices and/ornetworks; or differently arranged devices and/or networks thanillustrated in FIG. 2. Also, in some implementations, one or more of thedevices of the location illumination environment 50 may perform one ormore functions described as being performed by another one or more ofthe devices of the location illumination environment 50. Devices of thelocation illumination environment 50 may interconnect via wiredconnections, wireless connections, or a combination of wired andwireless connections. In aspects, additional or fewer components thanthose shown in FIG. 2 are utilized, separate components are integratedinto a single computing component or module, or single components ormodules are implemented as multiple computing components or modules.

FIG. 3 shows a flowchart of a method in accordance with aspects of theinvention. Steps of the method of FIG. 2 may be performed in theenvironment illustrated in FIG. 2, and are described with reference toelements shown in FIG. 2. Embodiments of the invention are performedutilizing the user computer device 60 to determine and implementillumination changes within a physical location. In alternativeimplementations, the user computer device 60 is utilized in conjunctionwith a remote lighting controller 70 to determine and implementillumination changes within a physical location.

At step 300, the user computer device 60 receives location informationregarding a select or localized area within a larger defined physicallocation. The physical location may be an enclosed location, such as atheatre or stadium, and may be an indoor or an outdoor location. Inaspects, the location information is in the form of image data from acamera (not shown) of the user computer device 60, or global positioningsystem (GPS) location information. Various location information toolsand methods may be utilized by the location illumination environment 50of the present invention to determine a localized area of interest to auser within the larger defined location. In embodiments, image data isobtained when a user utilizes a GUI module 72 of the user computerdevice 60 to capture image data (e.g., still frame or streaming) of anarea of interest to the user (i.e., localized area) within a largerlocation. For example, a user may utilize a camera (not shown) of theuser computer device 60 to capture image data of a center stage areawithin a larger theatre location. In embodiments, the user computerdevice 60 receives the location information from a remote device, suchas from one or more on-site cameras 66 and/or sensors 68. Inembodiments, the on-site cameras 66 provide image data to the usercomputer device 60, which can be analyzed to determine a specificlocation of a user within the larger defined physical location.Similarly, the on-site sensors 68 may provide sensor data (e.g., motionsensing data) to the user computer device 60, which can be analyzed todetermine a specific location of a user within the larger definedphysical location. Alternatively, the lighting controller 70 may receivethe location information in accordance with step 300, such as from theuser computer device 60, on-site cameras 66 and/or on-site sensors 68.

At step 301, the user computer device 60 determines the select orlocalized area of interest (hereafter localized area) based on thelocation information received at step 300. In aspects, the user computerdevice 60 includes image processing tools enabling the user computerdevice 60 to identify the localized area from image data captured by acamera (not shown) of the user computer device 60 or an on-site camera66 according to step 300. In implementations, the user computer device60 recognizes that the user computer device 60 is within the localizedarea utilizing contextual analysis and artificial intelligence tools. Inaspects, the user computer device 60 determines the localized area basedon sensor data received from one or more on-site sensors 68. Inembodiments, the localized area comprises a current location of amovable object (e.g., the user computer device 60) within the definedphysical location.

In alternative embodiments, the lighting controller 70 determines thelocalized area based on location information obtained from the usercomputer device 60. It should be understood that methods utilized by theuser computer device 60 to determine the localized area discussed abovemay be utilized by the lighting controller 70 in such alternativeembodiments. In one example, the lighting controller 70 obtains adigital image from a camera (not shown) of the user computer device 60,and analyzes the digital image to determine the localized area shown inthe digital image.

At step 302, the illumination module 78 of the user computer device 60,or alternatively, the illumination module 88 of the lighting controller70, determines a desired level of brightness for the localized areadetermined at step 301. In embodiments, the illumination module 78 or 88determines the desired level of brightness (illumination level) based oninstructions received from a user (e.g., user computer device 60)regarding a desired level of brightness, in accordance with substep302A.

In one example, a user interacts with a touchscreen of the user computerdevice 60 (e.g., using finger swipes, pinches or other touchscreen inputmethods) to indicate the level of brightness desired for the localizedarea shown as real-time camera image data on the touchscreen. In oneimplementation, the localized area is shown in an augmented realitydisplay on a touchscreen of the user computer device 60, wherein anactual image of the localized area is augmented with virtualillumination. In aspects, the augmented display is shared between theuser computer device 60 and the lighting controller 70. In thisimplementation, a user may utilize touchscreen commands (e.g., fingerswipes, etc.) to cause the virtual illumination to increase or decreasein brightness, wherein the illumination module 78 or 88 recognizes theincrease or decrease in brightness as a desired level of brightness forthe localized area. With such an embodiment, the brightness viewed by auser in the virtual image of the user computer device 60 may bereflected in the physical localized area with implementation of thelighting control steps discussed below.

Still referring to step 302, in embodiments, the illumination module 78or 88 determines a desired level of brightness for the localized areabased on a user selected predetermined lighting rule, in accordance withsubstep 302B. For example, a user may utilize a GUI generated by the GUImodule 72 of the user computer device 60 to select one or morepredetermined lighting rules from the lighting database 80. In thisexample, the user selection is received by the illumination module 78 or88, which determines the level of brightness based on the one or morepredetermined lighting rules selected. In aspects, a user is enabledthrough the user computer device 60 to create calendar based brightnesscontrol rules. In one example, a user focuses a camera of the usercomputer device 60 on a localized area of a physical location, indicatesa change in the level of brightness for the localized area (e.g., usingfinger swipes), and is presented with an option to select an event orcalendar based rule for the desired level of brightness. In this way,rules may be saved by the user computer device 60 in the rule database82, which enable the user computer device to automatically implementpredetermined brightness levels at the localized area according to thesaved rules (e.g., at a certain time, when a certain event is occurring,etc.). Similarly, in alternative embodiments, the lighting controller 70utilizes rules in the rule database 92 to implement step 302B.

With continued reference to step 302, in embodiments, the illuminationmodule 78 or 88 determines that a triggering event has occurred, anddetermines a desired lighting level for the localized area based onpredetermined rules associated with the triggering event in accordancewith substep 302C. In one example, the user computer device 60determines, based on the location information received at step 300, thata user has entered his or her office space, and determines the desiredillumination level for a desk area of the office space based onpredetermined rules for the office space stored in the lighting database80. In embodiments, historic user lighting trend data is gathered and/oranalyzed by the illumination module 78 or 88 in order to determine thedesired lighting level for the localized area. In another example, auser needs more brightness for a predefined action or activity (e.g.,reading). In embodiments, the illumination module 78 or 88 identifiesthat the user is performing the predefined activity (e.g., readingcontent) based on image data received from the one or more on-sitecameras 66, and recognizes this as the triggering event.

In embodiments, step 302 is implemented based on stored user preferencedata. For example, the illumination module 78 or 88 may determine that auser of the user computer device 60 is associated with stored userpreference data indicating the user's preference for a level ofillumination associated with the activity of reading.

At step 303, the illumination module 78 or 88 determines locations ofthe lighting devices 62A, 62B within the physical location. In aspects,the illumination module 78 or 88 stores and/or accesses lighting devicelocation data (e.g., coordinates or mapping data) in the lightingdatabase 80 or 90.

At step 304, the illumination module 78 or 88 determines currentillumination levels for lighting devices 62A and/or 62B within thedefined physical location. In embodiments, the illumination module 78 or88 accesses current illumination level data stored in the lightingdatabase 80 or 90. In aspects, the illumination module 78 or 88 utilizeslight sensor data from the on-site sensor 68 or other illumination datain order to determine current illumination levels of the lightingdevices 62A and/or 62B.

At step 305, the illumination module 78 or 88 calculates an illuminationlevel at the localized area based on the current illumination levelsdetermined at step 304 and the location of the lighting devices 62Aand/or 62B determined at step 303. In embodiments, the illuminationmodule 78 or 88 calculates the illumination level using the distance ofrespective light sources (lighting devices 62A, 62B) from the localizedarea. In aspects, multiple sources of light are available at a physicallocation, wherein each source of light contributes to the lightavailable across the entire physical location. The relationship betweenillumination and its effect at a distance is given by: E=I/D². In thiscase, the “D” is the distance from a light source to the localized area,the “I” is the illumination level at the light source, and the “E” isthe illumination level at the distance “D”. In embodiments, the cameramodule 74 of the user computer device 60 is configured to measure adistance of any object in an image captured by a camera of the usercomputer device 60, as well as lighting sources (e.g., lighting devices62A, 62B).

At step 306, the illumination module 78 or 88 determines a change inillumination required to meet the desired level of brightness (of step302). In aspects, the illumination module 78 or 88 determines the changein illumination required by comparing the current illumination level atthe localized area of step 305 with the desired level of brightnessdetermined at step 302. In embodiments, determining the required changein illumination comprises an overall illumination change needed to meetthe desired level of brightness for the localized area, as well asindividual illumination levels for each of the lighting devices 62Aand/or 62B at the physical location. In embodiments, the required changein illumination additionally comprises one or more changes to thedistance between a lighting device 62A, 62B and the localized area. Forexample, the illumination module 78 may determine that a change inillumination levels needed to meet the desired level of brightness atthe localized area requires certain illumination levels as well asposition changes among available lighting devices 62A and/or 62B. In oneexample, the illumination module 78 or 88 recognizes a triggering eventcomprising a user reading in a particular area of a physical location.In this example, the illumination module 78 or 88 automaticallydetermines a change in the level of brightness for the particular areaneeded to meet the desired brightness level associated with readingrules stored in the rule database 82 or 92.

In embodiments, the illumination module 78 or 88 determines a change inillumination required to meet the desired level of brightness at a firstlocalized area, while maintaining the desired level of brightness at asecond localized area. For example, a user may select two localizedareas of interest in accordance with step 301 of FIG. 3.

At step 307, the illumination module 78 or 88 generates instructions forone or more of the lighting devices 62A and/or 62B to effect a change inthe one or more lighting devices 62A and/or 62B based on the change inillumination determined at step 306. In embodiments, the instructionscomprise instructions to change the illumination level of one or morelighting devices 62A, 62B and/or instructions to change the physicalposition or location of the one or more lighting devices 62A, 62B. Inembodiments, instructions are generated for more than one localized areawithin a physical location. For example, in the case where the userselects two localized areas of interest in accordance with step 301, theillumination module 78 or 88 generates instruction to effect a change inthe one or more lighting devices 62A and/or 62B based on changes to meetdesired illumination levels in both the localized areas of interest.

At step 308, the lighting control module 76 of the user computer device60, or the lighting control module 86 of the lighting controller 70,sends the instructions of step 307 to at least one controller (e.g.,controller 63A, control module 63B) of the one or more lighting devices.In implementations where the user computer device 60 acts as anillumination control system, the lighting control module 76 of the usercomputer device 60 may send instructions determined by the illuminationmodule 78 to the controller 63A of the lighting devices 62A to effect achange in the illumination of the lighting devices 62A in accordancewith the instructions. Similarly, the lighting control module 76 of theuser computer device 60 may send instructions determined by theillumination module 78 to the control module 63B of the lighting devices62B to effect a change in the illumination and/or the position/locationof the lighting devices 62B in accordance with the instructions. Inimplementations, the control module 63B causes the lightingtransportation device 64 to change the location or position of one ormore lighting devices 62B according to instructions received from thelighting control module 76 or 86.

At step 309, the one or more lighting devices 62A, 62B change theirillumination output and/or position/location to obtain the desired levelof brightness for the localized area, in response to the controller 63Aand/or 63B receiving the instructions at step 308. In one example, thelighting device 62A increases its light output based on instructionsreceived at controller 63A from the lighting control module 86, and thelighting device 62B changes its position with respect to the localizedarea based on instructions received at the control module 63B from thelighting control module 86. Thus, embodiments of the invention enable auser to change a level of brightness in one or more localized areas of aphysical location, wherein each active light source (e.g., lightingdevice 62A, lighting device 62B) at the location contributes a differentportion of the change in the illumination level.

In embodiments, the localized area moves within the defined physicallocation. In such embodiments, the calculation of the illumination levelat the localized area (step 305), the generating of the instructions toeffect the change in the one or more of the lighting devices 62A, 62B(step 307), and the sending the instructions to the at least onecontroller (e.g., controller 63A, control module 63B) (step 308), areperformed on a continuous or periodic basis based on movement of themovable object within the defined physical location. In this way, adesired illumination level can be maintained in real-time for the movinglocalized area (e.g., a user of the user computer device 60).

Based on the above, it should be understood that embodiments of theinvention utilize the user computer device 60 as the illuminationcontroller for the location illumination environment 50 of FIG. 2, andalternative embodiments of the invention utilize the lighting controller70 as the illumination controller for the location illuminationenvironment 50, with input from the user computer device 60.

FIGS. 4A and 4B illustrate an exemplary use scenario in accordance withembodiments of the invention. The use scenario of FIGS. 4A and 4B may beimplemented in the environment of FIG. 2 in accordance with method stepsof FIG. 3.

FIG. 4A illustrates a defined physical location 400 including aplurality of light sources 401-404. Stationary light sources 402 and 403may be in the form of lighting devices 62A of FIG. 2 having one or morecontrollers 63A for controlling illumination thereof. Repositionablelight sources 401 and 404 are shown mounted to respective lightingtransportation devices 408 and 410. The repositionable light sources 401and 404 may be in the form of lighting device 62B of FIG. 2, with one ormore control modules 63B controlling illumination and/or the position ofthe lighting sources 401 and 404. In the example, shown, the lightingtransportation devices 408 and 410 comprise poles with moveable verticaltracks thereon (not shown) configured to move the repositionable lights401 and 404 between different vertical levels or heights.

Still referencing FIG. 4A, a user computer device 60 is shown in theform of a smartphone 416 including a touchscreen 418. In accordance withstep 300 of FIG. 3, a user indicated at 419 aims a camera (not shown) ofthe smartphone 416 at a localized area (an area of interest to the user)412, which includes an object in the form of a chair 414. Image datafrom the camera is sent by the smartphone 416 to the lighting controller70 for processing. In this embodiment, the lighting controller 70determines the localized area 412 using image processing tools, whereinthe lighting controller 70 recognizes the localized area 412 based oncontext analysis of the image (e.g., recognizing the chair 414, etc.).In the example of FIG. 4A, a user provides instructions regarding adesired level of brightness for the localized area 412 in accordancewith step 302A. More specifically, the user utilizes finger commands(e.g., fingers swiping apart) indicated at 420 to instruct the usercomputer device 60 to increase the level of illumination in theon-screen image (depicted on the touchscreen 418). In this exemplaryembodiment, the real-time camera image of the chair 414 is augmentedwith virtual illumination indicated at 422. The change in illuminationrepresented by the virtual illumination 422 is communicated to thelighting controller 70, which determines the desired level of brightnessfor the localized area 412 based thereon.

Turning to FIG. 4B, the lighting controller 70: determines locations ofthe lighting devices 401-404 in accordance with step 303 of FIG. 3;determines current illumination levels L1-L4 of the lighting devices401-404 in accordance with step 304 of FIG. 3; and determines a changein illumination required to meet the desired level of brightness for thelocalized area 412. In this example, the distance D1-D4 of the lightingdevices 401-404 from the localized area 412, and the currentillumination levels L1-L4 of the respective lighting devices 401-404 isutilized by the lighting controller 70 to calculate the currentillumination level at localized area 412 in accordance with step 305 ofFIG. 3. The lighting controller 70 next determines a change inillumination required at the localized area 412 to meet the desiredillumination level selected by the user 419 (depicted in FIG. 4A).

With continued reference to FIG. 4B, the lighting controller 70generates instructions for one or more controllers (not shown) of thelighting devices 401-404, and sends the instructions to the one or morecontrollers (e.g., controller 63A, control module 63B) to initiatechanges in the lighting devices 401-404 necessary to meet the desiredillumination level of the user 419. In this example, the lightingcontroller 70 sends instructions to change the illumination level oflighting devices 401-403 by different amounts, as well as instructionsto change the position of the lighting device 404 from a first position430, to a second position 431 closer to the localized area 412, in orderto obtain a desired aggregate illumination level at the localized area412. In aspects, while changing the level of brightness, software of thelighting controller 70 also calculates the impact of illumination levelson other localized areas of the location 400, such as a secondarylocalized area 440, and automatically selects an optimum level ofbrightness in different lighting devices 401-404 to meet illuminationgoals across the location 400 (including illumination goals forlocalized areas 412 and 440).

Based on the above, systems and methods of the present invention addressthe situation where multiple light sources are installed in a definedlocation, and each light source contributes different levels ofillumination to a point within the defined location. In aspects, theuser computer device 60 and/or the lighting controller 70 knows thecurrent position of various lighting systems in the defined location.Optionally, the position of the lighting is dynamic; in this case theuser computer device 60 and/or lighting controller 70 determines therelative position of the moving lighting equipment within the definedlocation. In implementations, the user computer device 60 and/orlighting controller 70 determine a current level of brightness at eachof the light sources.

In aspects, a user can use a mobile device (e.g., the user computerdevice 60) to select one or more areas of interest (localized areas),and using a finger gesture, for example, the user can graphically changethe illumination level at the selected areas. Based on the selectedillumination level if the area, embodiments of the present inventionenable the user computer device 60 or the lighting controller 70 toperform calculations to determine changes necessary to obtain thedesired illumination level at the selected areas based on aggregatedillumination levels from the various lighting sources (e.g., 401-404).

In embodiments, based on the change in the illumination level needed, amobile device (e.g., smartphone 416) will identify the percentage ofchange in the selected locations and then will identify the brightnesslevel in different lighting sources, or changes in the position of thelight sources (e.g. a drone is carrying a light) needed to meet theillumination goals for the selected locations. While selecting arequired illumination level in one or more select areas, a user canselect various event or calendar based rules, and the user computerdevice 60 or lighting controller 70 will act accordingly to implementnecessary illumination levels at the various light sources.

As an example, one computer-implemented method of the present inventionincludes: identifying one or more light sources in an area, wherein atleast one of the light sources could be adjusted; identifying thelocation of the light sources in relation to other light sources as wellas a user; receiving a user selection on a visual display of the areawith the light sources, wherein the user selection is an indication tochange the amount of light for the localized area of selection;calculating which lights to change the intensity and the amount ofchange required to reach a level of brightness the user desires; andadjusting the lighting sources in the area. In implementations, theselection on the visual display is a movable object (e.g., a person) andthe lighting adjusts in the area to keep the movable object at aconsistent level of brightness. In aspects, the visual display is anaugmented reality display that adjust brightness reality to conform tothe user's preference in augmented reality. In embodiments, the methodfurther includes identifying historical trends of a user toautomatically select a brightness for an area or object based on pastuser preferences.

In embodiments, a service provider could offer to perform the processesdescribed herein. In this case, the service provider can create,maintain, deploy, support, etc., the computer infrastructure thatperforms the process steps of the invention for one or more customers.These customers may be, for example, any business that uses technology.In return, the service provider can receive payment from the customer(s)under a subscription and/or fee agreement and/or the service providercan receive payment from the sale of advertising content to one or morethird parties.

In still another embodiment, the invention provides acomputer-implemented method for automatic illumination of a target areabased on aggregate illumination from multiple light sources. In thiscase, a computer infrastructure, such as computer system 12 (FIG. 1),can be provided and one or more systems for performing the processes ofthe invention can be obtained (e.g., created, purchased, used, modified,etc.) and deployed to the computer infrastructure. To this extent, thedeployment of a system can comprise one or more of: (1) installingprogram code on a computing device, such as computer system 12 (as shownin FIG. 1), from a computer-readable medium; (2) adding one or morecomputing devices to the computer infrastructure; and (3) incorporatingand/or modifying one or more existing systems of the computerinfrastructure to enable the computer infrastructure to perform theprocesses of the invention.

The descriptions of the various embodiments of the present inventionhave been presented for purposes of illustration, but are not intendedto be exhaustive or limited to the embodiments disclosed. Manymodifications and variations will be apparent to those of ordinary skillin the art without departing from the scope and spirit of the describedembodiments. The terminology used herein was chosen to best explain theprinciples of the embodiments, the practical application or technicalimprovement over technologies found in the marketplace, or to enableothers of ordinary skill in the art to understand the embodimentsdisclosed herein.

1. A computer-implemented method, comprising: calculating, by acomputing device, an illumination level at a localized area of a definedphysical location based on current illumination levels of a plurality oflighting devices within the defined physical location and locations ofthe plurality of lighting devices within the defined physical location;generating, by the computing device, instructions to effect a change inone or more lighting devices of the plurality of lighting devices,wherein the change in the one or more lighting devices results in adesired level of brightness for the localized area; and sending, by thecomputing device, the instructions to at least one controller of the oneor more lighting devices.
 2. The computer-implemented method of claim 1,wherein the instructions include instructions to change an illuminationlevel for each of the one or more lighting devices, and wherein each ofthe changes in the illumination level are different.
 3. Thecomputer-implemented method of claim 1, wherein the instructions includeinstructions to change a position of the one or more lighting deviceswithin the defined physical location.
 4. The computer-implemented methodof claim 1, further comprising: determining, by the computing device,the locations of the plurality of lighting devices within the definedphysical location; and determining, by the computing device, the currentilluminations levels for each of the plurality of lighting devices. 5.The computer-implemented method of claim 1, further comprisingdetermining, by the computing device, a change in the illumination levelrequired to meet the desired level of brightness for the localized area.6. The computer-implemented method of claim 1, wherein the determiningthe desired level of brightness for the localized area is based on apredefined lighting rule.
 7. The computer-implemented method of claim 1,wherein the localized area comprises a current location of a movableobject within the defined physical location, and wherein the calculatingthe illumination level at the localized area, the generating theinstructions to effect the change in the one or more of the lightingdevices, and the sending the instructions to the at least onecontroller, are performed on a continuous or periodic basis based onmovement of the movable object within the defined physical location. 8.The computer-implemented method of claim 1, further comprisingreceiving, by the computing device, lighting instructions from the userregarding the desired level of brightness for the localized area,wherein the desired level of brightness for the localized area is basedon the lighting instructions.
 9. The computer-implemented method ofclaim 1, further comprising determining, by the computing device,historic lighting trends associated with a user of the computing device,wherein the desired level of brightness for the localized area is basedon the historic lighting trends.
 10. The computer-implemented method ofclaim 1, further comprising determining, by the computing device, that atriggering event has occurred, wherein the generating the instructionsto effect the change in the one or more of the lighting devices occursin response to the triggering event.
 11. The computer-implemented methodof claim 10, wherein the triggering event comprises sensing that a useris performing a predefined action within the localized area.
 12. Thecomputer-implemented method of claim 1, further comprising: calculating,by the computing device, an illumination level at another localized areaof the defined physical location based on current illumination levels ofthe plurality of lighting devices within the defined physical locationand the locations of the plurality of the lighting devices within thedefined physical location; generating, by the computing device,secondary instructions to effect a change in one or more of theplurality of lighting devices, wherein the change in the one or more ofthe plurality of lighting devices results in the desired level ofbrightness for the localized area and the other localized area; andsending, by the computing device, the instructions to at least onecontroller of the one or more lighting devices.
 13. A computer programproduct comprising a computer readable storage medium having programinstructions embodied therewith, the program instructions executable bya computing device to cause the computing device to: calculate anillumination level at a localized area of a defined physical locationbased on current illumination levels of a plurality of lighting deviceswithin the defined physical location, and locations of the plurality oflighting devices within the defined physical location; generateinstructions to effect a change in one or more lighting devices of theplurality of lighting devices, wherein the change in the one or morelighting devices results in a desired level of brightness for thelocalized area; and send the instructions to at least one controller ofthe one or more lighting devices.
 14. The computer program product ofclaim 13, wherein the instructions are instructions selected from thegroup consisting of: instructions to change the illumination level ofthe one or more lighting devices; instructions to change a position ofthe one or more lighting devices within the defined physical location;and combinations thereof.
 15. The computer program product of claim 13,further comprising: determining, by the computing device, the locationsof the plurality of lighting devices within the defined physicallocation; determining, by the computing device, the currentilluminations levels for each of the plurality of lighting devices; anddetermining, by the computing device, a change in illumination for eachof the plurality of lighting devices required to meet the desired levelof brightness for the localized area.
 16. A system comprising: aprocessor, a computer readable memory and a computer readable storagemedium associated with a computing device; program instructions tocalculate an illumination level at a localized area of a definedphysical location based on current illumination levels of a plurality oflighting devices within the defined physical location and locations ofthe plurality of lighting devices within the defined physical location;program instructions to generate instructions to effect a change in oneor more lighting devices of the plurality of lighting devices, whereinthe change in the one or more lighting devices results in a desiredlevel of brightness for the localized area; and program instructions tosend the instructions to at least one controller of the one or morelighting devices; wherein the program instructions are stored on thecomputer readable storage medium for execution by the processor via thecomputer readable memory.
 17. The system of claim 16, further comprisingat least one of: a sensor; an on-site camera; and a lighting transportdevice.
 18. The system of claim 16, wherein the instructions include atleast one instructions selected from the group consisting of:instructions to change the illumination level of the one or morelighting devices; and instructions to change a position of the one ormore lighting devices within the defined physical location.
 19. Thesystem of claim 16, further comprising program instructions to determinethat a triggering event has occurred, wherein the generating theinstructions to effect the change in the one or more of the lightingdevices occurs in response to the triggering event.
 20. The system ofclaim 16, further comprising program instructions to determine thedesired level of brightness for the localized area based on stored userpreference data.